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Introduction 



In setting up a preassessment system for educators, it is usual to find 
many comments about the helpfulness and competency of individual state personnel. 
Sometimes, this praise is placed in the perspective of success in spite of 
bureaucratic rules. 

The tendency to focus on individuals can reflect an' Inability to cite specific 
strengths in an organization as a support system. However, any praise and 
recognition giv^n to individual members reveals that the support system has done 
a good job in assembling a strong professional staff. These strong individuals 
can be tied together by an effective organization. 

There is nothing original in the above thoughts. Many reports and magazine 
articles have made the same points previously. 



The objective of this document is to provide a sound conceptual basis for 
agencies that wish to provide support systems designed to preassess needs of 
prospective participants in regional workshops. 

In addition to conceptualization, the forms and plans contained in this 
document providi^. an example of successful implementation. 

Since it must never be forgotten that formative evaluation is sir ^ 
to the process we call evolution, the actual implementation steps in th. j 
document are alwayr open to revision and adaptation to meet local needs. 
This stress on a laptabil i ty to local needs is one step closer to accountabi 1 i ty 
to sponsoring agencies. 
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FOR THE READER IN A HLJRRY 



Evaluation of Health Occupations Education Regional Workshop 



The objectives of these evaluations include assessment of six health occupations 
regional wrkshops and the fieldtesting of new inscrvice evaluation instruments. 

Phase I of the evaluation includes tabulation of the evaluation results by 
the-Division of Research, 

Phase II includes tne tabulation of the evaluation instruments, both for 
participants and for utservers, by the workshop directors. These results will be 
reported to the appiopria^e funding agency. 



Baseline Data ; 

In addition to the two instruments referred to, evaluation by participants 
and evaluation by observers, each of these workshops has used a pre-planning 
assessment form. The basis for this detailed form is called model one. 

In the conceptual stage, it was assumed that a highly specific instrument 
could be mailed to all of the teachers concerned. From these detailed instruments, 
it was assumed that a consensus would develop as to the needs of the workshop. 

After the operational research on the first three workshops, model one of 
evaluation has been revised into model two, 

A. It is felt that a small limited sampling 
must be taken in order to come up with 
very specific questions that refer directly 
to the needs of the participants for a 
regional vrorkshop. 

B. These needs are to be refined into a 
questionnaire that can be sent to the 
general population of workshop candidates. 

C. The results of this questionnaire should 
provide specific input as to -hat the 
participants perceive as needs. 

At the present time, model two of pre-planning assessment cannot be 
investigated until the next round of workshops. The reason for this is simply 
that all six workshops were planned v/ith the first model. Feedback from the 
participating workshops proved that model one forms become too cumbersome and 
ambiguous when the large populatzion sampling is done without a more specific and 
concrete approach to the workshop pre-planning assessment. 

In brief, it is necessary to sample a small number of prospective participants 
for typical needs. Once these reeds have been mapped out in terms of the workshop, 
the entire population of teacher^; can participate by voting or by selecting 
important areas of concern. This type of validation seems to promise more relevant 
workshop planning. 



Operational Obiective : 

It is anticipated that three workshops will complet r-- forms, evaluation 

by participants and the evaluation by observers. It is c ic ited further that 
each of these workshops will tabulate the results and repc findings to the 
appropriate funding agency. It is anticipated that the data gathered in the last 
three workshops can be interpreted with as much success as was found in interpreting 
the data of the first three workshops. 

In general, the first three workshops concluded that: 

A, Workshop objectives must be presented in 
very specific terms to be understood by 
the prospective workshop candidate. 

B, At the workshop, either by presenter 
explanation or by suggestions by 
participants, concrete examples must 
be given of how the workshop objectives 
can be applied in the classroom, 

C, The transition of teacher competencies 
acquired at the workshop to learner 
benefits according to individuals taught 
by workshop participants is not an easy 
one. This transition must be fostered 

by constant repetition, frequent opportunities 
for practice, and voluntary feedback from 
workshop participants , 
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PREASSESSMENT, OBJECTIVES, AND EVALUATION ITEMS 



Preassessment 

A standardized preassessment form has been developed. 

This form was developed in cooperation with representatives of post-secondary 
health occupations education programs. 

This preassessment can be developed by looking at the samples provided in 
the section entitled PREASSESSMENT DOCUMENTATION. 



Objectives 

The objectives are to be developed by the workshop director. 

The objectives are to be approved by the state agencies sponsoring the 
workshop or conference. 

The state agency will look at the workshops from two viewpoints: 

1. Content: Do the workshops respond to the needs analysis? 

2. Format: Are the workshops specific, practical, appropriate, 

measurable, and observable? 

Once the objectives have passed through these two filters, measurement 
items will be developed for each objective. In general, at least two different 
types of measurement/evaluation items should be developed for each objective. 
This will provide for a variety of evaluation measures, instruments, tech- jes, 
means, and viewpoints. In this way, it can be determined whether or not tue 
project, workshop, or conference has accomplished what it intended to accomplish. 



Evaluation Itenis 

Once the above has been done, it is possible to key each evaluation itetr 
to a specific objective. 

This has another benefit. For each evaluation item, it can be determined 
beforehand what is understood by a positive or negative evaluation. Instead 
of coming up with global evaluation items that cannot be specificly diagnosed 
into remediable conference components, this evaluation comes up with a diagnostic 
evaluation individually designed for the specific needs and objectives the 
conference. 
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£ii-ASSESSMENT 
DOCUMENTATION 

Cove r_Letter sample dated February 24, 1975 

jiOEi:RP F _JlEAR ll — Health Occupations Education Program Preassessemnt Fo 

(for Pa^^t; i c i pants) 

HQ£:^E£JlNEE£)SlJ^Qg9g_ljL ~- HOE Program Preassessment Form 

(for Program Needs) 

continuation from page 1 

MQE-O&i^- HOE Sample Conference Object eves 



I 



I 



I 



February 24, 1975 



Snclosed please find three products resulting from the 
February 21, 1975 planning meeting for HOE Regional Conferences: 



1. HOE-PPF (PART) 

HOE PROGRAM PREASSESSMENT FORM (TOR PARTICIPANTS) 

2. HOE-PPF (NEEDS) 

HOE PROGRAM PREASSESSMENT FORM (FOR PROGRAM NEEDS) 

3 . HOE-OB J 

HOE SAMPLE CONFERENCE OBJECTIVES 



As agreed at the meeting, both HOE-PPF (PART) and HOE-PPF (NEEDS) 
are to be administered by all participating HOE regional conference 
directors. Individual colleges may add on to these program preassessment 
forms, but no college will delete any Item. 

As agreed at the meeting, each HOE regional conference director 
will distribute these forms to prospective participants. Each regional 
conference director will mall the tabulated results of the program 
preassessment forms before May 1, 1975 to: 



HOE regional conference directors will use the results of the 
program preassessment forms in order to develop relevant conference 
objectives. These conference objectives will follow the format Indicated 
on HOE SAMPLE CONFERENCE OBJECTIVES. This will stress workshop goals, 
participant (teacher) objectives, and student (high school, BOCES) 
objectives. Development of objectives in this threefold format is for 
the purpose of documenting that HOE regional conferences focused on 
changing teacher behavior do result in significant measurable increases 
In student achievement. 



Howard P. Alvlr 



Sincerely yours. 




Howdrd P. Alvlr 
Associate in Research 



Bncls. 
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PLEASE raiNT OR TYPE ; 

HDE-PPF (PART) 

HOE PROGRAM PREASSESSMENT FORM (for PARTICIPANT?') Name " 

Address 

HOE PARTICIPANT CHARACTERISTICS 

City, State, Zip 

DIRECTIONS: Place response in the space provided. . ^ . 

School 

For multiple choice answers^ circle the appropriate letter. 

1. Social Security Number (optional before acceptance): 

2. Title or Position: 



3. Health Specialty (Professional Affiliation): ^ 

4, Area of Health Occupations Education Teaching: 

A, Dental Assisting 

Dental Laboratory Assisting 
€• Environmental Health Assisting 

D, Health Assisting (Including such locally used titles as Health 
Services, Health Careers, Ir i-oductlon to Health Occupations, 
Health Core/Foundations, and Similar Titles) 

E* Home Health Assisting 

F» Medical Assisting 

G. Medical Laboratory Assisting 

H. Medical Therapy Assisting 
I» Mental Health Assisting 
J. Nurse's Assisting 

K. Practical Nursing 
L. Other; specify: 

5. HOE Certification: (Use A to L as in 4 above), 

A* B. C. D. E. F. G. H. I. J. K. L. 

6, Course (s) Taught/Responsible for: 



7, Extent of Clinical Supervision Responsibilities: 

8, Years of Health Experience: 

9, Years of Teaching Experience: (specify levels) 

10. Age Grouping of Person Responding: 

<A) 20-29; (B) 30-39; (C) 40-49; (D) 50 and above 
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HOE-PPF (NEEDS) (p^g^ j) 

HOE PROGRAM PREASSESSMENT FORM (for PROGRAM NEEDS) 



HOE PROGRAM NEEDS ASSESSMENT 
PART 1 ; COMMON CORE PREASSESSMENT 

DIRECTIONS: Place responses In the spaces provided. 



1. Where do you want the emphasis during the two day regional conference? 

basic content Job markets 

new concepts career mobility 

teaching methods • changing roles 

other; specify in question 2 

2. Specify any areas not mentioned above you would like covered if 
given the opportunity: 

A. 



B. 



C. 



Nominate experts you would like to have on the conference faculty: 
A. 



B. 



C. 



4. What sort of HOE facilities are available to you? (check ail that apply) 

classroom AV equipment: specify 

lit independ«:nt (individualized) study 

classroom laboratory innovative program; specify ^ 

learning laboratory other; specify 

available ' 

_____ anticipated 

5. What is your average class size? 



6. What population levels are taught in your HOE classes (Give percentages). 



7, High School 
% Adult 



7.. What is the total enrollment in your HOE classes (Give numbers). 



number of high school students 

number of adult students 

11 
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HOE-PPF (NF?:DS) (page 2) 



PART 2 : LOCAL PREASSESSMENT QUESTIONS 

8« Do you want overnight accomraodatlons? 

Yes 

one night 

^^^^ two n-'.glits 
No 

9. What is your transportation: Mode of arrival? 



10. Are you Interested In planned evening activities? 

Yes 

cultural 

recreational 
conference related 

No 
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BOEH)BJ 

HOE Sample Conference OBJECTIVES 



SAMPLE HOE CONFERENCE 
GOALS AND OBJECTIVES 



Workshop 
Goal 


Participant (Teacher) 
Oblective 


Student (HS, BOCES) 
Obiective 


This workshop Intends to: 


The participating 
teacher is able to: 


Students taught by partic- 

f pa tine: teachers can* 


Identify changes and new 
developments 


Specify market 
expectation (KO) 
Provide reality 
orientation (AO) (PC) 


Who can do what (PO) 
hHow exciting is the job 
fi(AO) 

^How much brain work (KO) 
^(independent decision 
taking) 


Stimulate more effective 
collaboration and use of 
coimnunlty resources 


Clear ug ambiguities 

(KO) about job 

description 

Feel more secure (AO) 

Pinpoint the lob market 

(PO) 

Prepare learners (PO) 

(a) in view of career 
opening 

(b) in line of expressed 
personal interests 
fAO) 


Visualize actual "on the 
job" reality (KO) 
Simulate the fit of the 
career chosen (AO) 
Anticipate the chance to 
get a job where frained 
(PO) 


Brln^ the handicapped 
Into the mainstream of 
employment 


Identify jobs where the 
handicapped are 
especially matched to 
job demands (KO) 
Demonstrate actual 
case histories of 
handicapped who cashed 
in on the handicapping 
conditions (PO) 


Demonstrate how certain 
handicapping conditions 
are assets in certain 
jobs (AO) 

• microscopic study 
(immobilized) 

o no gossip, no phones 
(deaf) (lip read) 

• meticulous and monotonou 
(mental retarded) 

0 tactile perception 
(blind) 

• from dictation to 
typing or computer 
keyboard (blind) 


Articulate ts^nnnAayxr tt-I «-t-t 

post-secondary level 
proerammlne 


vxaxL Life clL>LUclx (vcliupua 

laboratories and 
facilities (PO) 


Keceive nirs c nana a a vice 
and counseling (AO) 




NOTE: 

KO * Knowledge 
Objectives 

PO Performance 
Objectives 

AO = Attitude 

Oblectives 
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PROPOSED PLAN FOR EVALUATING SIX HOE REGIONAL CONFERENCES 
SPONSORED BY COMMUNITY COLLEGES 



The following proposed plan is an example of what can be done with 
available personnel. 

This evaluation plan enables high level administrators to function on a 
high policy level. 

Similarly, technical details are taken care of by technical staff. 

Furthermore, tabulation can be accomplished by clerical staff. 

No claim is made that the following proposed plan is perfect, but it 
is workable in the sense that clear cut and moderate objectives are specified. 
In addition, a timetable has been developed to monitor the step-by-step 
implementation of these desired objectives. At no time, have dreams been 
allowed to replace achievable and worthwhile accomplishments. 
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DRAFT 



PROPOSED PLAN FOR 
EVALUATING SIX HOE REGIONAL CONFERENCES 
SPONSORED BY COMblUNITY COLLEGES 



PERS0NN>:L INVOLVED: 

1) Ruth Ellen Ostler, Chief, Bureau of Healch Occupation Education 

2) Mrs. R. Winnifred Johnson, Associate in Health Occupation Education^ and 
Subject Specialist Consultant 

3) Howard P. Alvir, Associate in Occupational Education Research and 
Continuing Consultant 



EVALUATION MANDATE: 

At the request of the BHOE Bureau Chief, the mandate of the 
evaluation plan is to: 

1. Develop a form suitable for use in identifying the 
interest and needs of potential participants as a 
basis for program design. (This form is to be 
developed by the workshop directors with the 
consultation of the evaluation personnel.) 

2, Consider appropriate conference e aluation 
procedures. (A distinction will be made between 
the task performed by the workshop directors and 
by the evaluation personnel.) 

In accordance with the suggestions laid down by the BOER bureau 
chief, the following will be done: 

1. Three independent groups will be sampled: 

Group I will consist of State Education Department 
Occupational Education personnel. 

Directors feielefeld. Post, Sutler) 

Chiefs 

Associates 

BISE personnel 1 5 
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Group II will consist of an independent sample of HOE 
teachers from high schools and BOCES' not 
participating in the six HOE regional workshops. 

Part of group II will be drawn from schools. 

Other parts of group II will be drawn from 
professional meetings. 

Group III will consist of participants selected for the 
six HOE regional conferences. 

2. Statistical analysis will be made to determine the levels of 
significance of the differential reactions of the above groups 
with regards to the following parameters of HOE inservice 

con ferences : 

Objectives 
Evaluations 
Resources 
Process 

3. Where possible, further statistical analysis and tests of 
significance will be made to pinpoint the differential 
responses according to the following teacher variables: 

Years of teaching HOE 

Years of work in health occupations 

Years of simultaneous HOE teaching and 

work in health occupations 
Academic degrees 
Certification 



INSTRUMENTATION: 

Eventually, three evaluation instruments will be developed: 

1. An initial survey instrument (to be given before the workshop 
and to be used as a basis for program design). 

2. An overall conference evaluation (to be given the last day 
of the conference as a final summatlcn of participant 
opinion) . 

3. A followup questionnaire (to be given 6 months after the 
conference and in order to document benefits to learners). 
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TIMETABLE 



The immediate objective of the evaluai 
initial survey form to be used as a basis i 
timetable has been adopted; 



m design is to develop the 
program design. The following 



February 5, 1975: 



February 21, 1975j 



Before March 21, 1975: 



H.P. Alvir and R. W. Johnson develop an 
overall evaluation plan, this document. 

The six directors of the six regional 
conferences meet in Albany to develop the 
initial survey form and to agree upon 
evaluation procedures. 

P, Alvir and R, W. Johnson develop . the 
necessary supplemental form to round out the 
evaluation form oeveloped by the workshop 
directors . 



Before May 2, 1975: 



June 14, 1975: 



All workshop directors have tabulated and submitted the 
results of the initial survey form. 

Agreement is to be reached between evaluation 
personnel and the six conference directors 
as to the contents of the OVERALL CONFERENCE 
EVALUATION FORM and the FOLLOWUP QUESTIONNAIRE. 



DIVISION OF RESPONSIBILITIES: 

The evaluation personnel are available on a continuing consultation 
basis. It is presumed that this consultation will take place during the 
meeting held on February 21 and by telephone. At the present time, no 
provision is made for on site visitation to the six community colleges. It 
is the job of the evaluation team to: 

1, Develop the supplemental evaluation forms. 

2, Monitor the deadline for the workshop directors to submit 
tabulated data. 

3, Compare the data submitted by all six conference directors 
by making the appropriate statistical tests of significance 
and group analyses. 

4, Recommend essential program design elements that become 
evident during the statistical comparison of the six 
regional conferences. 

5, Monitor all evaluation form developed in order to make 
sure that the evaluation traces the benefits of the six 
regional conferences to documented benefits to classroom 
students taught by participants of the regional workshops. 
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In other words, teachers will be the participants at the 
six regional conferences. 

The focus of the evaluation is to make sure that the 
classroom students taught by conference participants 
derive documented benefits from these six regional 
conferences • 

Sound oiit Cha agreements and disagreements of State 
Education ctcupational educators, the general population 
of school-based HOE educators, and HOE educators selected 
for participation in regional conferences. 

In cases where groups I, II, and III agree, the extent 

of this agreement is to be spelled out. 

In cases where groups I, II, and III disagree^ the extent 

of this disagreement is to be tracked down. 

In certain cases, teacher characteristics can be correlated 
with certain agreements and disagreements. As far as the 
areas of agreement and disagreement are concerned two 
general areas of investigation emerge: 

The question of what is to happen to ^ 
teachers at the six HOE regional 
conferences? 

What is to happen to classroom 
students taught be participating ROE 
teachers? 
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RESPONSIBILITIES OF THE CONFERENCE DIRECTOR 



The large number of responsibilities for the conference director have been 
listed in a more or less sequential approach. This means that the first item 
listed should be taken care of in the appropriate order, ^ 

In order to maximize effectiveness, it is possible to rearrange these 
day-by-day tasks into an overall perspective. The framework provided in the 
overall perspective is a recommendation and obviously can be further subdivided 
into individual tasks. 
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RESPONSIBILITIES OF THE CONFERENCE DIRECTOR 



The director of the conference, workshop, program, or project will 
the following: 



Submit a letter of Intent which specifies overall 
conference goals. 

Submit a written proposal, at least 8 weeks before 

the conference begins, specifying objectives, * * 

ev;>luations, resources, content, and activities 

planned • 

Submit a detailed budget by filling out form JTyZ-ABC 
in which all costs are explained and justified. 

File and retain for fiscal purposes the ief:ter of 
allocation outlining the approved budget. 

File and re^ain for fiscal purposes the official 
authorization which legally permits encumbering 
funds and recurring expenses. 

Execute all administrator guidelines as specified 
in the official handbook. 

Prepare the final report in the format required. 

Submit requests for payments as scheduled. (With complete documentation). 

Submit requests for 8% override on instructional 
costs as figures on the total budget excepts stipends. 
(Without need for documentation) 

Set up a local fiscal account number to draw against as 
expenses are incurred. 

Send out application blanks to all participants that specify: 

(a) the applicant is certified 

(b) the applicant is actually teaching 

(c) the applicant is approved by the signature of the school superintenden 

Submit stipend reimbursement only for amounts actually paid 
out, with a distinction made between overnight participants and 
commuters. 

20 
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Make sure that fees are imposed equally upon all attendees 
and not only upon those publicly financed* . 

Make sure that consultants are kept in the limitations of 
fee maximums, travel maximimis, and per diem expenses 
maximums • 

Make sure that reimbursement to local staff is in line 
with actual salaries and costs incurred. 

Make sure that the conference brochures specifies the 
funding under which the conference is sponsored. 

Publish clearly all eligibility requirements for such 
things as graduate credit. 

Enforce attendance requirements which distinguish 
between eligible and ineligible applicants . 

Be ready for rmllocation to receive more students if 
other conferences provide empty slots. 

Set up a list of reasonable deadlines and "due"dates 
in order to insure enough room for the local staff 
to maneuver. 

Develop, distribute, and tabulate the program 
preassessment form with all essential information. 

Publicize the maximum permissible amounts for fees, 
travel, meals, and lodgings. 

Rent all necessary equipment since purchase is forbidden. 

Make sure that all materials distributed and expended 
fall in the category of permitted workbooks rather than 
in the category of textbooks. 

Clarify the normal teaching load, overtime such as 
Saturday, Sunday, and evening, as well as preparation 
time at each institution. 
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OVERALL PERSPECTIVE 



The preceding lists of responsibilities of the conference director 
l8 detailed. In order to provide a slmpller framework within which to 
conceptualize the categorization of these responsibilities, the following 
list is provided, 

1) Identify NEEDS of Occupational Education 

SKILLS of Higher Education institutions 

2) Plan proposals, price, and approve the INTERVENTION 

3) Publicize the STAFF DEVELOPMENT 

OPPORTUNITIES 'aval lab le " 

Looking at this threefold categorization will enable the conference 
director to keep track of a large number of important items without 
forgetting important priorities. 
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INSERVICE WORKSHOPS EVALUATION DESIGN 



The workshop director is given three tasks; 

Development 

Approval 

Surveys 



The professional evaluator is given three tasks: 

Analysis 

Correlation 

Sampling 



Developing workshop plans means listing benefits in some type 
of priority order. 



Approving evaluation instruments means listing each evaluation 
item sequentially in some type of a response order. 



Analyzing each of the benefits listed and developed means 
making sure each beaefi*: is appropriate, specific, measurable 
or accountable, and reasonable. 



Correlating evaluation items and benefits means identifying 
which evaluation item measures each specific learner benefit. 



Correlating the sample instrument with the workshop evaluation 
instrument means translating each evaluation item into at least 
four different parallel forms. 



Form 1 

Form 2 

Form 3 

Form 4 



The teacher performs 

The teacher is observed performing 

The learner performs 

rhe learner is observed performing 



In addition, these different formats can be applied to the workshop 
director, the workshop staff, the supervisor or administrator of the 
workshop, the workshop participants, non-participants of the workshop, 
students taught by participants, and students taught by non-participants, 



23 

19 



1^1'!;;^;° "'"i'' ^1^7 ^ benefit-by-benefit. evaluation item-by-evaluation 
s^ples! according to a wide variety of observational 

Sun?r?i\'''^^"f ^ ^^^^ ^^^i^^y °f "'-thods and 

counts to be used in determining the success of the workshop. 

evafuatioi; ^^^^^""t levels can be seen according to competency 

Level I: The teacher acquires a new Qompetency 

Level II: The teacher tries out the new competency in the school 

Level III: The teacher adapts the new competencies according to 
difficulties or obstacles encountered locally 

Level IV: The teacher documents learner benefits resulting from 
a newly acquired teacher competency 
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INSERVICE WORK SH OPS EVALUATION DESIGN 



Spring - Sunimer 1975 



W orkshop Diroctor 

does the following: 

Develops purposes, goals, objec- 
tives, benefits, processes, plans, 
products, or reasons for the 
workshop in concert with staff. 



External Evaluator 

does the ioilowing: 

1. Analyzes v;orkshop expect-^tions to 
see if 

a. appropriate to inservice education 

b. specific 

c, measurable or countable 

d, reasonable 



Approves an individualized evalu- 
ation instrument developed, 
revised, or selected by workshop 
staff as an acceptable yardstick 
of success (i£., measurable gains). 



Surveys : 

a. each staff member end partici- 
pant v;ith the approved evaluation 
instrument at least at the end of 
the v'orkshop 

b. administrators, teachers, and 
students to measure impact upon 
classroom instruction and learning 



2. Correlates ; 

a« each evaluation item with the 
prespecified expectations of the 
workshop 

b. each workshop expectation and 
evaluation item with a xc-asurable 
learner benefit acceptable to the 
workshop director 

3. Samples independently in October 1975 
following workshop 

a. staff members and director 

b. supervisors or administrators 

c. workshop participants (classroom 
teachers) 

d. non-participants (classrooui 
teachers) 

e. . students (of participants) 

f. students (of non-participants) 
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DEVELOP TORKSHOP PLANS 



Benefit A 
Benefit E 
Benefit C 
Benefit I> 
Benefit E 



APPROVE EVALUATION INSTRUMENT 

Item 1 • 
2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 
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ANALYZE BENEFITS 





Appropriate 


Specific 


Measurable or 
Countable 


Reasonable 


Benefit A 


9 


No 


? 


Yes 


Benefit B 


Yes 


Yes 


Yes 


Yes. 


Benefit C 


Yes 


? 


No 


? 


Benefit D 


No 


Yes 


Yes 


No 


Benefit E 


. Yes 


Yes 


Yet.. 


No 



f 



ERIC 



CORRELATE EVALUATION ITEMS AND BENEFITS 

Benefit A jjs measured by : 

• Item 10 
Item 11 

Benefit B i£ measu red by : 

Item 1 
Item 5 
Item 9 

Benefit C i^ measured by : 

Item 2 

Benefit D i^ measured by : 

Item 3 
Item 7 

Benefit E ±s^ measured by : 

Item 4 
Item 6 
Item 8 
Item 12 
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CORRELME SAMPLING INSTRUMENT OTTH 
WORKSHOP EVALUATION INi>xRUMENT 



CODING 



Letter Code 



Description 



Evaluation Item 



la 



lb 



Teacher performs 



Teacher is observed 
performing 

Learner performs 



Did you as a teacher perform 
competency 1? 

Did the teacher being observed 
perform competency 1? 

Did you as a student acquire 
success 1? 



Ic 



Learner is observed 
performing 



Did your students acquire 
success 1? 



Workshop 
Instrument 


Workshop 
Partici- 
pant 


FOLLOI^P PARALLEL SAMPLES 


Dir. 


Staff 


Sugvrs 
Admm . 


Partici- 
pants 


Non- 
Part. 


Stud, of 
Part. 


Stud, of 
Non-part. 


Item 1 


1 


la 


la 


la 


1 


1 


lb • 


lb 


Item 2 


2 


2c 


2c 


2c 


2c 


2c 


2b 


2b 


Item 3 


3 


3a 


3a 


3a 


3 


3 


3a 


3a 


Item 4 


4 


Ac 


Ac 


Ac 


Ac 


Ac 


Ar, 


Aa 


Item 5 


5 


5a 


5a 


5a 


5 


5 


5b 


5b 


Item 6 


6 


6c 


6c 


6c 


6c 


6c 


6a 


6a 


Item 7 


7 


7a 


7a 


7a 


7 


7 


7a 


7a 


Item 8 


8 


8c 


8c 


8c 


8c 


8c 


8a 


8a 


Item 9 


9 


9a 


9a 


9a 


9 


9 


9b 


9b 


Item 10 


10 


10a 


10a 


10a 


10 


10a 


10b 


10b 


Item 11 


11 


11a 


11a 


11a 


11 


11a 


lib 


lib 


Item 12 


12 


12c 


12c 


12c 


12c 


12c 


12b 


12b 
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SAMPLE RESULTS 



Benefit 
Claimed 


Evaluation 


Wkshop 
Dir. 


Wkshop 
Staff 


Supvrs 
Admin. 


Parti- 
cipants 


Non- 
Part. 


Stud, of 
Part. 


■ Stud, of 
Non-part. 


A 


Item 


10 


1007, 


757a 


607, 


507, 


A07, 


307, 


317, 




Item 


11 


0 


0 


AO 


50 


10 


70 


10 




Item 


1 


100 


80 


10 


10 


30 


15 


30 




Item 


5 


100 


80 


80 


70 


30 


60 


20 




Item 


9 


100 


80 


85 


75 


25 


65 


25 


c 


Item 


2 




SO 


J3 


->-> 






51 


D 


Item 


3 


100 


50 


AO 


30 


30 


15 


5 




Item 


7 


0 


25 


30 


20 


15 


20 


31 


E • 


Item 


U 


0 


0 


10 


20 


10 


30 


10 




Item 


6 


100 


80 


70 


80 


AO 


70 


30 




Item 


8 


0 


60 


70 


90 


30 


80 


20 




Item 


12 


100 


80 


70 


80 


AO 


70 


20 



ANALYSIS 




Benefit A = 




Benefit B = 


Yes 


Benefit C = 


1 


Benefit D = 


No 


Benefit E = 


Yes 



SAMPLE EVALUATION. POSSIBILITIES 



I nterna I 
Externa I 

Survey 

Quest i onna i re 
Teacher ova I uat i on 
Check I ist 
Observat i on 
Anecdota I 
Rating scales 
State forms 
Psycho I 09 i st 

Ach i evement pretest i ng 
Ach i evement posttest i ng 
Behavioral change 

Count : 

# times service used 

# part i c i pants 

# using services 

# service units 

# phone inquiries 

# hours of service 

# spontaneous plaudits 
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DEPT. OF HEW 



ATI INSTITUTE OF EDUCATION 



ERIC 



DATE FILMED 



ERIC 



ERIC 




ERIC 




ERIC 




ERIC 



